Modular device and data management system and gateway for a communications network

ABSTRACT

A gateway provides duplex-directional, multimedia ad hoc mesh networking, peer-to-peer direct communications, power optimization, dynamic configuration, and data management, while operating within various devices and network topologies. A multitasking virtual machine monitor for mobile networked devices, that is capable of functional expandability and portability to various operating environments, interoperability with a variety of operating systems, the Gateway Control System (GCS) performs functional capabilities in both a local and a networked topology using local and remote hardware and software. Software within the GCS is partitioned into sequentially, autonomous code, referred to herein as “modules,” each module being configured to communicate with hardware and other gateway modules. Collectively, all gateway modules are referred to herein as the gateway stack (GS). Each member of the GS can be turned on or off, downloaded from a remote site, and dynamically configured.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. non-provisional applicationSer. No. 15/597,169, filed May 17, 2017, which is a continuation of U.S.non-provisional application Ser. No. 14/940,131, filed Nov. 12, 2015,which is a continuation of U.S. non-provisional application Ser. No.14/217,409, filed Mar. 17, 2014, which claims the benefit of U.S.provisional patent application Ser. No. 61/852,156 filed 15 Mar. 2013.Each patent application identified above is incorporated herein byreference in its entirety to provide continuity of disclosure.

BACKGROUND OF THE INVENTION Technical Field

The invention relates to a communications network. More particularly,the invention relates to a modular device and data management system,and a gateway for a communications network.

Description of the Background Art

When wireless/cellular phone technology was initially commercialized,cellular phones were simple transmitter/receiver devices, i.e. suchdevices had no networking capabilities outside of their cellular carriernetwork and were limited to voice-only communications and SMS textmessaging. These cellular phones were hand-held devices, a hands-freeoption was introduced that required plugging in a wired headphoneconnection between the phone and an earpiece and microphone. Over time,some new technologies evolved.

Most notably:

-   -   Bluetooth Communication Protocol is an open wireless technology        for short-range wireless communications with a maximum range of        100 to 200 feet and that enables wireless devices to communicate        with each other over short distances: With the introduction of        the Bluetooth communication protocol, wireless phones could        communicate with other devices over a short range. This        advancement in technology created a new market for wireless        accessories. The very nature of the protocol eliminated the need        for a wired device to establish hands-free operation and        wireless peer-to-peer communications, Now, the user could use a        cellular phone to communicate with an accessory (or any        Bluetooth enabled device) over a personal area network, thus        truly making the use of the device hands-free.    -   WiFi Wireless Local Area Networking set of standards based on        the 802.11 2.4 GHz frequency bands with a maximum range of 350        to 800 feet with original data transfer speeds of 5 to 11        megabytes per second (mbps) and newer versions claiming 100 to        200 mbps. The WiFi protocol greatly expanded the use of the        Internet by providing WiFi enabled computers and handheld        devices to have easy access to the Internet via Wireless Access        Points or “Hot Spots” through a router connected to a wired        Cable or DSL link to an Internet Service Provider. This made it        possible for local coffee shops, bookstores, and businesses to        provide free or low cost wireless access to the Internet to        anyone with a WiFi enabled device.    -   Digital Video Cameras and Audio-Video Streaming: With the advent        of digital imaging cameras capable of capturing and storing        images and videos in a digital format, the next step in the        evolution of the video cameras was their ability to stream the        video over wireless networks.

What these devices have in common is a dependency either on another morepowerful computing and/or communications device or on the Internet foruploading and sharing data and one-way streaming of captured audio-videofeed. Recently, a hands-free wireless video camera telecommunicationsheadset has been invented that represents a new generation of entirelyautonomous wearable two-way and multi-feed hands-free wirelesscommunications devices capable of sending and receiving voice, data, andaudio-video without the need for a paired external, handheld, wired orwireless computing, networking, or storage device (see U.S. patentapplication Ser. No. 12/714,693, filed 1 Mar. 2010, which application isincorporated herein in its entirety by this reference thereto).

The hands-free wireless video camera telecommunications headset providesvoice, data and audio-video streaming to and from a hands-free wirelessmobile device. Further, it provides multiple embodiments of a videocamera telecommunications headset with a retractableviewfinder/monocular display and a laser rangefinder offered as either asingle unit hands-free wireless real-time bi-directional and multi-feedtelecommunications headset or as a modular Bluetooth earpiece headphone(Headphone) unit with a detachable handheld cellular video camera unit,with the earpiece unit serving as either a stand-alone wirelessBluetooth Headphone and personal media player or as a wearablemultimedia port for the detachable handheld cellular video cameratelephone unit that when linked together operate as a single autonomoushands-free wireless video communications headset capable of still imageand audio-video capturing, recording and streaming to and from areceiver or group of receivers and real-time viewing and control ofcaptured and/or received audio-video feeds via the retractable monocularviewfinder or other paired multimedia display system.

Further, such device includes headset accessories including anadjustable docking station for recharging and/or use of the headset as astationary wired or wireless IP camera, removable/rechargeable earpieceand neckpiece battery units for continuous hands-free wireless mobileheadset, headphone and/or other ported device operations and a pair ofmultimedia sunglasses for active binocular display and eye to cameraautomation of the headsets optical and digital zoom, day and nightvision camera.

Stemming from a need for a ubiquitous peer-to-peer direct networkingplatform for the telecommunications headset capable of pairing theheadset with any existing Wide, Metro or Local, and Personal AreaNetworked device or group of devices; and supporting real-timemulti-feed, multi-channel bi-directional video streaming, meshnetworking, and coordinated device operations, including a remote viewfinder, camera zoom and remote systems control, it became apparent thatsuch a platform did not exist.

Due to an ever increasing number of Bluetooth and WiFi enabledelectronic devices, such as digital cameras, media players, and portablevideo game players, and a myriad of smart phones that operate onincreasingly intelligent and incompatible mobile operating systems thatare developed by competing technology companies and that are often soldexclusively through individual carrier networks that use proprietaryradio frequencies and that are capable of supporting widely varyingbandwidth speeds, there is a need for a ubiquitous scalable platformthat is capable of installation and operation on, and in coordinationwith, a diversity of devices networks and operating systems.

Equally apparent was the need for a secure, device-based Mobile Ad-hocDirect Peer-to-peer Communications Network where each networked deviceor node acts as an independent router, transmitter, and receiver andconnects directly to another device or group of devices without the needfor a wired or wireless access point, Wireless Carrier Network, orInternet Service Provider.

SUMMARY OF THE INVENTION

The herein disclosed gateway device and data management and networkingsystem preferably comprises a hypervisor, a virtual machine monitor forwireless networked devices, and a ubiquitous scalable platform formobile ad-hoc mesh networking, dynamic network configuration and securedata transfer, channeling, and communications over any wired or wirelessnetwork.

An embodiment of the invention comprises a gateway that encompasses suchcapability as, for example, bi-directional multimedia networking, poweroptimization, dynamic configuration, communications, and datamanagement, while operating within various devices, operating systems,and network topologies. An embodiment is configured to run in anembedded system, as a downloadable platform and/or as a networkedapplication. A presently preferred embodiment of the invention thuscomprises a multitasking device, data, and network management systemcapable of functional expandability and portability to various operatingenvironments.

Functionality provided by an exemplary embodiment of the inventioncomprises, for example:

-   -   Bi-directional and multi-feed voice, data, and audio-video        communications over a direct peer-to-peer wireless mesh network;    -   A ubiquitous virtual machine monitor capable of configuration        and interoperability with a variety of mobile device operating        systems;    -   A modular device management system and ad hoc networking        platform scalable for a wide range of networked devices;    -   A platform for grouped device intelligence, coordinated task        management and data, power, and network optimization;    -   Dynamic mesh communications, and real-time coordination of        unified, federated, managed, and scalable network        configurations;    -   Dynamic and secure data channeling over multiple wireless        protocols and networks;    -   Complete system-wide capability-based security settings;    -   Complete systems automation for hands-free wireless and remote        device operations, remote view finder, and remote systems        control; and    -   Dynamic hardware and software configurability.

Functional capabilities within the herein disclosed gateway areperformed in both a local and a networked topology using local andremote hardware and software. Software within an embodiment of thegateway is partitioned into sequentially, autonomous code, referred toherein as “modules,” each module being configured to communicate withhardware and other gateway modules. Collectively a set of device modulesare referred to herein as the Device Module stack (DMS). When a group ofGateway Devices collaborate they form a single Gateway Module Stack(GMS) that is reflected by each of the networked Gateway Devices.Depending on the security settings set by the user, user group and/ormanaged network each module in a DMS and each DMS in a GMS can be turnedon or off, disconnected or dynamically re-configured by an authorizeduser or network manager.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block schematic diagram showing gateway layers according tothe invention;

FIG. 2 is a block schematic diagram showing gateway architectureaccording to the invention;

FIG. 3 is a block schematic diagram showing a gateway stack according tothe invention;

FIG. 4 is a block schematic diagram showing an operating system moduleaccording to the invention;

FIG. 5 is a block dataflow diagram showing an operating system moduleprocess according to the invention;

FIG. 6 is a block schematic diagram showing a security module accordingto the invention;

FIG. 7 is a block dataflow diagram showing a detailed security moduledescription according to the invention;

FIG. 8 is a block schematic diagram showing control center moduleaccording to the invention;

FIG. 9 is a block schematic diagram showing power management moduleaccording to the invention;

FIG. 10 is a block dataflow diagram showing a power management moduleprocess according to the invention;

FIG. 11 is a block schematic diagram showing a network communicationsmodule according to the invention;

FIG. 12 is a block dataflow diagram showing a network communicationsmodule process according to the invention;

FIG. 13 is a block schematic diagram showing a locational orientationmodule according to the invention;

FIG. 14 is a block dataflow diagram showing a locational orientationmodule process according to the invention;

FIG. 15 is a block schematic diagram showing a voice module according tothe invention;

FIG. 16 is a block dataflow diagram showing a voice module processaccording to the invention;

FIG. 17 is a block schematic diagram showing an audio/video moduleaccording to the invention;

FIG. 18 is a block dataflow diagram showing an audio/video moduleprocess according to the invention;

FIG. 19 is a block schematic diagram showing a user interface moduleaccording to the invention;

FIG. 20 is a block dataflow diagram showing a user interface moduleprocess according to the invention;

FIG. 21 is a block schematic diagram showing a data management moduleaccording to the invention;

FIG. 22 is a block dataflow diagram showing a data management moduledescription according to the invention;

FIG. 23 is a block schematic diagram showing an applications moduleaccording to the invention;

FIG. 24 is a block schematic diagram showing a standalone gatewayaccording to the invention;

FIG. 25 shows an example of a standalone gateway headset according tothe invention;

FIG. 26 is a block schematic diagram of a machine in the exemplary formof a computer system within which a set of instructions for causing themachine to perform any one of the herein disclosed methodologies may beexecuted;

FIG. 27 is a block schematic diagram showing control center moduleaccording to the invention; and

FIG. 28 is a block schematic diagram showing an applications moduleaccording to the invention.

DETAILED DESCRIPTION OF THE INVENTION

An embodiment of the invention comprises a gateway modular device anddata management system that encompasses such capability as, for example,duplex-directional multimedia networking, power optimization, dynamicconfiguration, communications, and data management, while operatingwithin a variety of devices and network topologies. The gateway servesas a functional model for device automation, modular system and datamanagement, data channeling, paired, grouped and/or networked deviceoptimization, and hands-free and remote systems control,

Although technically an operating system, the gateway may be moreaccurately defined as a device, data and network optimization andcontrol system, A presently preferred embodiment of the Gateway ControlSystem (GCS) comprises a virtual machine monitor that is configured torun in an embedded system as a downloadable program or as a networkedapplication. A preferred embodiment of the invention comprises amultitasking control system that is capable of functional expandability,portability to various operating environments, and interoperability withexisting operating systems.

Gateway Control System

Functional capabilities within the herein disclosed gateway areperformed in both a local and a networked topology using local andremote hardware and software. Software within an embodiment of thegateway is partitioned into sequentially, autonomous code, referred toherein as “modules,” each module being configured to communicate withhardware and other gateway modules. Collectively, all gateway modulesare referred to herein as the gateway stack (GS). Each member of the GScan be turned on or off, downloaded from a remote site, and dynamicallyconfigured.

Modular Device Management

In the Gateway control system, device optimization is managed in anintelligent semi-autonomous modular architecture with each moduleselecting the most effective method for accomplishing each task based onuser configurations for power, data, device, network, security, andcommunications. Different sets of systems and tasks, such as powermanagement, data management, voice command and communications,Audio-Video Systems, and Geographic and Contextual Systems, and allrelated hardware, programs and components are organized into standard,virtual modular management systems.

Targeted environments for a presently preferred embodiment of thegateway are primarily focused within five areas:

1. System: The gateway Control System (GCS) has its foundation based onthe portability provided by the open sourced Linux Operating System anda number of Real-Time Operating Systems (RTOS), such as VxWorks, PSOSand MTOS. Its portability is achieved by partitioning core functionalitysoftware from targeted system dependent software. Thus, the gateway hasthe ability to run in an embedded environment or as a downloadableimage. Multitasking capability of both Linux and available RTOS's isexploited by the gateway, as is the ability to dynamically download,install, and execute new tasks, and the ability to control taskexecution characteristics remotely.2. Device: Many battery powered electronic devices have a powermanagement system limited to shutting down most components at once aftera period of time to extend battery life. The gateway performs its powermanagement functionality dynamically by constantly monitoring, managingand optimizing power use for all local and networked device systems,components and applications based on factors such as componentcharacteristics, power use history, time since last used, prioritysettings, security level, network topology, and user preferences and allnetworking characteristics such as geography (location and distance),routing3. Data: All data collected and managed by each module can operate as anindependent channel with all modules and data coordinated with othermodules and can either be grouped with other module data and sent outcollectively over a single wired or wireless network or broadcastindependently via a unique data channel over multiple availablenetworks. Using this model, a cellular only Gateway device cancommunicate with a WiFi only device by mesh networking with one or moreGateway Cellular and WiFi enabled devices and/wireless routers whichrelay the data stream to and from the targeted user.4. User: An authorized user, user group, and/or network manager cancustomize the core functionality of any Gateway enabled device, group ofdevices, or network by defining their use preferences for each GatewayModule and Security and Networking preferences for all related modularsystems control and modular data management, access, channeling, andcommunications.5. Network: The GCS combines the methods and capabilities of multiplerouting protocols and network topologies for Mobile ad hoc and MeshNetworking (MANET) such as reactive and proactive (Hybrid) routing,Hierarchical Routing, Temporally-ordered Routing Algorithm (TORA),Geographical Routing (Geocasting), Power-aware and Multicast Routing,Dynamic Source Routing (DSR) and Concurrent Multi-path Routing (CMR)into one dynamic scalable, platform and peer-to-peer device network.Gateway Peer-to-Peer Device Network1. Grouped Device Coordination

When two or more autonomous gateway enabled devices (Gateway Devices)join or connect as a Unified, Federated, Managed, or Coordinated Groupover any combination of wired and wireless protocols and networktopologies the Module Stack (MS) of each of the autonomous devicesexpands to include the Module Stacks of the other gateway devices, thusgenerating a single collective Gateway Module Stack (GMS) that ismirrored by each of the grouped devices.

In a Gateway Module Stack (GMS), the individual module stacks of eachdevice acknowledge and adopt the related components and systems of theother networked devices and groups them into a Networked Component Set.The Networked Component Set is a virtual embodiment of all remote modulestacks and related components. Once a GMS has been generated, eachindividual device module stack then independently calculates the mostefficient distribution of system priorities, tasks, and responsibilitiesfor the collective group of devices. The device with the fastestprocessing speed is dynamically selected as a primary or lead device toensure the most rapid updating and networking of data. A standardrefresh rate is also selected for the GMS based on the averagenetworking speed across all grouped devices. A new lead device isautomatically selected if the primary or lead device disconnects fromthe group.

2. Capability-Based Security

The Gateway Control System (GCS) offers a platform for total device,systems, and network configuration. The security settings extend toevery facet of device operations and systems control from the level ofaccess a user has over device functionality and applications to limitingdevice communications to a group of authorized devices. A user and/orauthorized network manager may also define the type of devices, groups,and or networks with which a managed device and/or user can connect, thenature, location, and/or duration of a group formation, and the types ofdata and method of data transfer. By pre-configuring device security andoperational parameters a user, user group, and/or managed network canset up an autonomous networking system for any number and diversity ofnetworked devices and users.

Any number of additional security systems and parameters may also be putadded to the Module Stack of a single device or managed group ofdevices, such as a user, device, and/or network password, authorization,and/or access code, a geographic identifier, such as device locationand/or orientation to another device, group of devices, and/or specifiedlocation, and any authentication mechanism, such as a voice fingerprint,iris scan, or other system and/or program based method of user, device,and/or network identification.

3. Dynamic Source Routing

The GCS serves as a dynamic source routing system that uses attributesfrom a number of routing protocols for Mobile ad hoc and Mesh Networking(MANET), such as reactive and proactive (Hybrid) Routing, HierarchicalRouting, Multipoint Relay, Temporally-ordered Routing Algorithm (TORA),Geographical Routing (Geocasting), Power-aware and Multicast Routing,Dynamic Source Routing (DSR), and Concurrent Multi-path Routing (CMR)into one platform.

4. Data Channeling and Communications

All data collected and managed by each module can be channeled directlyfrom a source Gateway Device to one or more receiving devices. The datacan be streamed and/or transferred via a virtual machine monitorinterface link configured between one or more networked Gateway Devices.Voice, contextual, and audio-video data is channeled either as acollective gateway stack over a single wired or wireless network, orbroadcasted independently via a unique module data stream over one ormore available networks. Using this model, Gateway Devices usingdifferent networks can communicate by mesh networking with one or moreBridge Nodes (Gateway Devices operating as routers) which then relay thedata stream securely to and from one or more networked devices.

5. Dynamic Network Configuration

When the Gateway Stacks (GS) of two or more Gateway devices recognizeeach other and join a collective Gateway Module Stack, the GMScoordinates the optimum group or network configuration and/orcoordinated cluster of groups and network configurations based on thelevel of access and security settings of each networked device and theoptimized network configuration for power, bandwidth, availableprotocols, location, and other routing parameters.

The following functional grouping and networking formats provide aplatform for dynamic network formation.

Unified Group

-   -   In a Unified Group Configuration each gateway device authorizes        complete module stack and related system access to another        device or group of devices. When individual module stacks in        each device are set to authorize, the device acknowledges and        adopts the related components and systems of the other networked        devices and groups them into a Networked Component set. The        unified module stack then seeks out the most efficient        distribution of system priorities, tasks, and responsibilities        collectively for the entire group of devices.        Federated Group    -   Alternatively, a user or user group can join a Federated Network        of Gateway devices in which all devices maintain their autonomy        and simply serve as a wireless router or bridge node supporting        in the optimized transfer of data and network channeling, device        coordination, and optimized communications, but have no access        to networked data or devices and no remote systems control        because all transferred data is channeled to an authorized        receiving device and is not capable of being accessed or        received by any authorized receiving device with optional key or        data encryption available        Managed or Hierarchical Network    -   In a Hierarchal Managed network configuration a server based        Managed Gateway Network can be set up by an enterprise or        agency, such as a police department, and all issued gateway        enabled wireless devices can be authorized as a managed device        and then either permanently assigned to a specific user or        temporarily assigned to a specific user or group of users with        all user, device, data, and network authorization set up via a        network-based hierarchy. A set of user identification and        authorization programs may be put into place with different        users gaining different levels of access and control over a        device, group of devices, and/or network configuration based on        the user's security clearance.        Architectural Layout for the Gateway

A presently preferred embodiment of the gateway is logically thought ofas partitioned into two layers (see FIG. 1), i.e. a module core layer 10and module OS interface 11 layer, with functionality focused on:

-   -   Module core: this layer is responsible for performing high        level, coordinated functionality. It makes up the core gateway        software that is compiled and linked only.    -   Module OS interface: this layer is primarily responsible for        directly allowing a module applications layer to map a module        core layer I/O with a given device's resident operating system.        Its intent is to be customized, compiled, and linked with the        module core layer.    -   Module Network Interface: using the Network and Communications        Module, the Network Interface is primarily responsible for        device-to-device, device-to-group, and device-to-Network data,        systems, and Module Core Layer interface coordination, data        channeling, and systems optimization, over one or many network        topologies, based on optimum efficiency and the security        settings of each device and of the entire group and/or network.        Environments for the Gateway

Targeted environments for the gateway are focused within the followingareas:

-   -   Hands-free wireless devices, such as the Telecommunications        Headset, and other digital video cameras, media players,        portable video-gaming devices, media glasses, clothing, watches,        and other low power, networked electronic devices and        accessories.    -   Cell Phones, Smart phones, and PDA's.    -   Tablets, PC's, Networked Televisions, and Video Gaming Systems.    -   Vehicle Media Systems, Dashboard consoles, Telematics, and other        vehicular computing systems supporting an Ad-hoc networking        platform.    -   Fleet Management and Transportation Systems    -   Home Security, Entertainment, and Command Centers    -   Enterprise VPN's and private security systems    -   Government departments, agencies, and networks such as police,        fire, medical, and emergency response, state, and Federal law        enforcement agencies.    -   Wireless Carrier Networks and Internet Service Providers        Architectural Overview

The gateway is an invention encompassing duplex-directional multimedianetworking, power optimization, dynamic configuration, communicationsand data management while operating within various devices and networktopologies. A presently preferred embodiment involves the coordinationand execution of twelve unique modules, known here as the gateway stack(GS) (see FIG. 2).

In total, the GS 20 provides the following functional capabilitieswithin the three environments:

-   -   Duplex-directional Audio/Video/Data communications 25;    -   Simultaneous communications over wired and wireless based        networks 25;    -   Audio capture and processing 28;    -   Video capture and processing 28;    -   Data management storage and retrieval 30;    -   Global Positioning System oriented functionality 26;    -   User Interface functionality 29;    -   Remote network and local access and control of both gateway and        non-gateway devices 23;    -   Plug-and-Play capabilities 21;    -   Local and remote device power management 24;    -   Voice recognition 27;    -   Local and remote security 22; and    -   Ability to expand functionality by adding new GS modules 31.

To meet both the functional capabilities and portability over the threeoperating environments, the gateway is layered as shown in FIG. 3, i.e.the core layer 10, the operating system interface layer 11, and theoperating environment 32.

Gateway Data

The gateway provides a mechanism for expanding the types and quantity ofdata used by GS modules. All data communicated, stored and processeduses a general format known by all GS modules. Actual data format isknown by one or more GS modules.

Gateway Data Types

The gateway provides a mechanism for categorizing data. Data isassociated with system inputs, module inputs and module outputs. Modulesare required to know both the type and format of data being received andtransmitted. See Table 1 below.

TABLE 1 Categorized Gateway Data Type List Data Type Description AudioRaw or processed digitized sound waves Video Raw or processed digitizedvideo signals Talk Processed Audio signals associated with a generalconversation Voice Highly processed Audio signals associated with anindividual Control Data used to specify actions or report statusinformation Orientation GPS, geo-relational and relative positioningdata Contextual Combination of two or more data types in a knownrelationship

Each Data type is provided a unique identification known to one or moreGS modules. This provides the gateway with the capability of expandingthe data type list when new components or modules requiring unique dataare added.

Gateway Data Record

To address the variability associated with run-time data processed by GSmodules, data is processed as a record and formatted as shown in Table 2below

TABLE 2 Categorized Gateway Data Type List Data Fields Description DataType Type of data in record Data Length Current length of data ActualData DataGateway Channel Communications

Channels provide the mechanism for all GS modules to communicate dataand control information.

Gateway Modules

Operating System Module

As shown in FIG. 4, an embodiment of the operating system module 21 isconfigured to run in an embedded system 40 and/or as a downloadableimage 41. The operating system module (OSM) (see FIG. 5) provides thegateway with support and access to the resident operating system 50. TheOSM has services 51, 52 that map the gateway hardware needs toappropriate resident operating system control and service routines.

Operating System Module Process

Power-Up Sequence for Gateway Operating System Module

-   -   Scan for all local data storage hardware using resident OS if        services and respond to data management module's request for        local fixed and removable data storage components;    -   Scan for all local user input and display hardware using        resident OS if services and respond to user interface module's        request for local user input and display hardware components;    -   Scan for all local imager and audio I/O hardware using resident        OS if services and respond to audio video modules' request for        local audio and video system components;    -   Scan for all local orientation hardware using resident OS if        services and respond to locational orientation modules' request        for local locational orientation hardware and system components;    -   Scan for all local network hardware using resident OS if        services and respond to network communications modules' request        for local network communications components;    -   Scan for all local power hardware using resident OS if services        and respond to power management modules' request for local power        components; and    -   Wait until the security module has allowed continued processing.        Continuous Operating System Processing Sequence    -   Resident OS if services for local fixed and removable data        storage components include:        -   Continuously monitor for changes to local data storage            hardware using resident OS if services and respond to data            management module's request for local fixed and removable            data storage components; and        -   Continuously monitor and process service requests to local            data storage hardware using resident OS if services and            respond to data management module's request for local fixed            and removable data storage components.    -   Resident OS if services for local user input and display        hardware components include:        -   Continuously monitor for changes to local user input and            display hardware using resident OS if services and respond            to user interface module's request for local user input and            display hardware components; and        -   Continuously monitor and process service requests to local            user input and display hardware using resident OS if            services and respond to user interface module's request for            local user input and display hardware components.    -   Resident OS if services for local audio and video system        components include:        -   Continuously monitor for changes to local imager and audio            i/o hardware using resident OS if services and respond to            audio video modules' request for local audio and video            system components; and        -   Continuously monitor and process service requests to local            imager and audio I/O hardware using resident OS if services            and respond to audio video modules' request for local audio            and video system components.    -   Resident OS if services for local locational orientation        hardware and system components include:        -   Continuously monitor for changes to local orientation            hardware using resident OS if services and respond to            locational orientation modules' request for local locational            orientation hardware and system components; and        -   Continuously monitor and process service requests to local            orientation hardware using resident OS if services and            respond to locational orientation modules' request for local            locational orientation hardware and system components.    -   Resident OS if services for local network communications        components include:        -   Continuously monitor for changes to local network hardware            using resident OS if services and respond to network            communications modules' request for local network            communications components; and        -   Continuously monitor and process service requests to local            network hardware using resident OS if services and respond            to network communications modules' request for local network            communications components.    -   Resident OS if services for local power components include:        -   Continuously monitor for changes to local power hardware            using resident OS if services and respond to power            management modules' request for local power components; and        -   Continuously monitor and process service requests to local            power hardware using resident OS if services and respond to            power management modules' request for local power            components.            Security Module Description

For the following discussion, refer to FIGS. 6 and 7 and Table 3 below.

TABLE 3 Security Profile Element Description Security Profile ID Id ofgateway device Security Pattern Pattern used for verification purposesSecurity Level Granted Security Level Security Pattern Type Voice,Video, Audio, Control, Contextual Security Type User, Device, NetworkWeighted Value Weighted valued used in security process Request TypePower-up/Event

The security module (SM) 22, using a combination of hardware andsoftware, provides controlled and secure access to local systemcomponents 60, local network communications components 61, and remotesystem components 62. Secure access revolves around gaining entry to agateway. Controlled access defines the scope of gateway functionalityavailable.

Three types of gateway security are processed and maintained: user,device, and network.

User type security is associated with granting access by a person,initiated by a login procedure, to a local or remote gateway andassigning access privileges.

Device type security involves access of another gateway or electroniccomponent.

Network type security involves gateway groups and comprises loosely andtightly coupled, depending on the type of group topology. Tightlycoupled security comprises full merging of gateway module stackfunctionality and is associated with paired and cluster network groups.Loosely coupled is associated with limited interplay of gateway modulestacks and managed, federation, hierarchical, Federation₂ and networktopologies.

All types of security requests, both incoming and outgoing, are storedand accessed by the SM.

Tightly coupled control includes standalone, paired, and clusteredgateway topologies. Loosely coupled control includes managed,federation, hierarchical and Federation₂ topologies. As discussed above,by continuously monitoring the gateway, three categories of access aremaintained: user, device, and network. As these users, devices andnetworks switch between online and offline modes, security profiles 70(FIG. 7) are maintained for each, describing the level and breadth ofaccess granted, along with information necessary for validation. Thesesecurity profiles are stored, both locally and remotely and used at thetime of request for granting of access.

During the validation process, the security module, as specified in asecurity profile, lists what local or remote system components areneeded and the data pattern, relative to those system components, thatare used to validate an access request. The data patterns used can be ofany type of digital signal electronically readable by a computerizedsystem: voice, sound pattern, electronic, eye pattern, fingerprint, andalphanumeric keypad input.

FACTOR IN Managed SECURITY

Security Module Process

Power-Up Sequence for Gateway Security Module

-   -   Scan for all local system components physically within the        gateway;    -   Scan for available local network communications components; and    -   Scan for and process any outgoing network access requests        available on any local data storage components.        Continuous Input Access Request Processing Sequence    -   Continuously monitor for incoming access requests to gateway:        -   Continuously monitor for user security requests, involving a            combination of user interface module input components;            video, audio, voice signals; network communications            components; and electronic and electro-mechanical            components:            -   User interface module input components include keypad,                mouse, joystick; processing involves comparison of                security profile pattern to component input, including                alpha-numeric value and position location;            -   Video, audio, voice signal inputs, including eye scans,                voice recognition, and tone detection;            -   Network communications components involve reception of                the security profile; and            -   Electronic and electro-mechanical component inputs,                including digitized signal.        -   Continuously monitor for device security requests, involving            a combination of network communications messages; electronic            or electro-mechanical components:            -   Network communications components involves reception of                the security profile; and            -   Electronic and electro-mechanical component inputs,                including digitized signal.        -   Continuously monitor for network security requests,            involving network communications components:            -   Network communications components involves reception of                the security profile.    -   Continuously process any incoming access requests by a comparing        the incoming request in combination with data storage resident        security profiles involving security pattern type, security        pattern, weighted level, and security type:        -   If available, respond with rejection if unaccepted; and        -   If available, respond with acceptance if accepted.    -   Continuously monitor for any changes to availability of local        and remote system components, both within the gateway and within        a paired or clustered gateway group:        -   User interface module input components include keypad,            mouse, and joystick;        -   Video, audio, and voice signal inputs;        -   Local network communications components; and        -   Data storage components.    -   Continuously monitor and store on data storage components any        new and updated security profiles using local and remote user        interface module components and local network communications        components.    -   Process and store input representation on local data storage        component newly created security profile input representation        base on component profile's characteristics.        Continuous Output Access Request Processing Sequence    -   Continuously monitor for any new and updated security profiles        on data storage components requesting access to standalone,        paired, clustered, managed, federation, hierarchical,        Federation, and network topologies.    -   Continuously process and transmit using local network        communications components any new and updated security profiles.    -   Continuously monitor and process response to output access        request using local network communications components:        -   If accepted, then continue; and        -   If not accepted, then stop.

TABLE 3a Module Profile Module Profile Element Description ModuleProfile ID Id of specific applications module Module Status On/OffStarting Location Entry point of application module Local/Remote Local -directly accessible Remote - Accessible via a Local Network SystemPriority Level 1—Lowest Priority → x—Higher Priority Data Types UsedVoice, Talk, Audio, Video, Locational, Contextual and Control dataActivation type Cyclic, Event, Both Cycle Time How often to start themodule

The Control Center Module (CCM) 23 (see FIG. 8), using a combination ofhardware and software, provides for the activation and control of alllocal and remote (61) GCS modules. By monitoring the availability andunique characteristics of all local (80) and remote (81) modules, theCCM will grant execution based on each modules status, priority andactivation type.

Control Center Module Process

Power-Up Sequence for GCS Control Center Module

-   -   Scan for all Local Module Profiles (see FIG. 27) within the GCS    -   Scan for all Local Storage Profiles available on any Local Data        Storage Components.    -   Scan for available Local Network Communications Components    -   Wait until the eyeCam Security Module has allowed continued        processing        Continuous Control Center Processing Sequence    -   Continuously monitor for entering a Paired and Clustered Group        topology and transmit using Local Network Communications        Components stored on Data Storage components all Module Profiles        to other group members.        -   Continuously monitor SM access privileges associated with            request    -   Continuously monitor for and process new and updated incoming        Module Profiles from Standalone, Paired, Cluster, Managed,        Federation, Hierarchical, Federation, and Network Groups using        Local Network Communications Components or Contextual Data and        storing on Data Storage Components.        -   Continuously monitor SM access privileges associated with            request    -   Continuously monitor for and queue by Priority Level for        activate all Local and Remote Modules with Activation types of        Cyclic and Both that their Cycle Timer has expired.    -   Continuously monitor for and queue by Priority Level for        activate all Local and Remote Modules with Activation type of        Event that have Channels with the specified Destination ID.    -   Continuously monitor for and queue Channels with the specified        Destination ID to all Local and Remote Modules with Activation        types of Cyclic and Both not currently active.        Power Management Module

The power management module (PMM) 24, using a combination of hardwareand software, provides controlled and functional optimization of powerusage for maximum battery life. By continuously monitoring andcoordinating control of electronic and electro-mechanical componentusage, both locally and remotely, the PMM optimizes gateway power usagebased on current needs, resulting in improved power consumption andbattery life.

The PMM continuously monitors the availability of all accessible localand remote electronic and electro-mechanical components. Thesecomponents are grouped by the PMM into power sources 90/90 a and powersinks 91/91 a. Power sources, as defined by the PMM, provide power tothe gateway. Power sinks require power. Each accessible component has apower profile 101 (see FIG. 10 and Table 4, below) defined andmaintained by the PMM for use in overall system coordination and controlof power use. Information contained within the power profile is used bythe PMM include whether the module is a power source or power sink,impact on power usage, location, and control characteristic. The leveland type of control imposed by the PMM involves what type of topologythe gateway resides. If a member of stand alone, managed, federation,hierarchical, Federation, and network groups, its primary focus is localcontrol. As a member of a paired or cluster group, its focus is on thegroup with all actions are coordinated with other members.

The level of control of all accessible electronic and electro-mechanicalcomponents is depended on the characteristics of each component andgateway network topology. Control includes responsiveness, on/off andanalog adjustments, resolution, and feedback. The network topologydirectly involved in determines if the PMM must coordinate its actionswith other group members by factoring in remote electronic andelectro-mechanical components characteristics.

Power Management Module Process

TABLE 4 Power Profile Element Description Power Profile ID Id ofspecific hardware/system component Power Type Power Source - Suppliespower to device Power Sink - Uses power to device Power Usage How muchpower used/supplied Power Location Local - directly accessible Remote -Accessible via a Local Network System Current Level If Power Source -current energy output level If Power Sink - current energy input levelCurrent Status On/Off Power Priority 1—High Priority → x—Lower PriorityPower-Up Sequence for Gateway Power Management Module

-   -   Scan for all local power components physically within the        gateway;    -   Scan for all local system components power profiles available on        any local data storage components;    -   Scan for available local network communications components; and    -   Wait until the security module has allowed continued processing.        Continuous Power Management Processing Sequence    -   Continuously monitor for entering a paired and clustered group        topology and transmit using local network communications        components stored on data storage components all local power and        system power component power profiles to other group members;    -   Continuously monitor for and process new and updated incoming        power profiles from standalone, paired, cluster, managed,        federation, hierarchical, Federation₂ and network groups using        local network communications components or contextual data and        storing on data storage components:        -   New power profiles comprise all components; and        -   Updated power profiles comprise current level and current            status;    -   Continuously monitor and transmit new and updated incoming power        profiles to paired and cluster groups using local network        communications components;    -   Continuously monitor and transmit on request new and updated        power profiles to standalone, managed, federation, hierarchical,        Federation₂ and network groups using local network        communications components;    -   Continuously monitor, process and store all active and        accessible gateway local power source levels:        -   Continuously monitor all power profile power sources levels            and store in power profile's current status; and        -   Continuously calculate current power source levels and store            in power profile's current level factoring in all active            power sink power profile's power type, power usage and            current levels;    -   Continuously calculate all active and accessible gateway local        power sink levels:        -   Continuously monitor all power profile power sink levels and            store in power profile's current status; and        -   Continuously calculate current power sink levels and store            in power profile's current level;    -   Continuously monitor and control all power interface devices        using power profile power source and power sink components:        -   Continuously monitor all power source components current            levels; and        -   Continuously control all power sink components current            status.            Network Communications Module

The network communications module (NCM) 25 (see FIGS. 11 and 12), usinga combination of hardware and software, provides controlled andfunctional routing and optimization of communications for datathroughput. By continuously monitoring the availability, type of networkconnection and format of data to communicate, the NCM sets up, maintainsand optimizes communications between the gateway and networked devicesand their applications.

When first powering up, the NCM audits for all available local networkcomponents, including wired 112, wireless 111, and hardware bus 110interfaces. Each unique interface has a communications profile 120maintained and stored by the NCM containing current and maximum speeds,adjustability and manual or automatic control. As new network devicescome on line and their network components 113, 114, 115 are madeavailable to the gateway, a communications profile 121 is alsomaintained and stored by the NCM. See, also, Tables 5 and 6 below.

The NCM is also responsible for transmitting data between the gatewayand network devices and applications. By maintaining a network entityprofile for each network device, remote gateway module stack module andremote hardware component, the NCM insures duplex-directionalcommunications over multiple networks, multiple components, and multipleapplications.

Optimization of communications by the NCM to a network device involvesone of two operations: changing the local network component'stransmission speed or switching to another local network component.Factors involved in determining what to perform, if any, include:availability of multiple local network component connections to thenetwork device, current transmission speed, network component prioritylevel, data record type, data type and data record priority level. If atransmission speed change is deemed appropriate, the NCM performs achange-in-speed operation with the remote network device prior totransmission of data at the new speed.

TABLE 5 Communications Profile Element Description CommunicationsProfile ID Id of specific hardware/system component CommunicationsStatus On/Off Current transmission/ Current rate of sending andreceiving data reception rate Maximum Maximum rate of sending andreceiving data transmission/reception rate Local/Remote Local - directlyaccessible Remote - Accessible via a Local Network System AdjustableYes - Adjustable transmission/reception rate transmission/reception rateNo - Not adjustable Priority Level 1—High Priority → x—Lower PriorityControl Type Manual or Automatic Network Type Standalone, Paired,Clustered, Managed, Federation, Hierarchical and Federation₂, Networked

TABLE 6 Network Entity Profile Element Description Network ID Id ofspecific network resident module Communications Link Local NetworkCommunications Component used Maximum Maximum rate of sending andreceiving data transmission/reception rate Type of Network Entity ModuleStack Module Application Remote Network Component Priority Level 1—HighPriority → x—Lower Priority Control Type Manual or Automatic RequestType Power-up/EventNetwork Communications Module ProcessPower-Up Sequence for Gateway Network Communications Module

-   -   Scan for all gateway local network communications components        comprising of wired, wireless, and hardware bus components;    -   Scan for all local network communications components        communications profiles available on any local data storage        components;    -   Scan for all local network communications components network        profiles available on any local data storage components;    -   Request activation of and network profiles with request type of        power-up; and    -   Wait until the security module has allowed continued processing.        Continuous Network Communications Processing Sequence    -   If no local network components are available, the network        communications module turns off;    -   Continuously monitor for entering a paired and clustered group        topology and transmit using local network communications        components stored on data storage components all local        communications profiles to other group members;    -   Continuously monitor for and process new and updated incoming        communications profiles from standalone, paired, cluster,        managed, federation, hierarchical, Federation, and network        groups using local network communications components or        contextual data and storing on data storage components:        -   New communications profiles comprise all components; and        -   Updated communications profiles comprise status and            transmission/reception rates;    -   Continuously monitor and transmit to other paired or clustered        group members' local network communications components' current        status and transmission/reception rate;    -   Continuously monitor for and process upon request new and        updated communications profiles from standalone, managed,        federation, hierarchical, Federation₂ and network groups using        local network communications components and storing on data        storage components:        -   New communications profiles comprise all components; and        -   Updated communications profiles comprise status and            transmission/reception rates;    -   Continuously monitor for and transmit requests by local gateway        module stack modules of local gateway module stack module's data        to specified network entity devices;    -   Continuously monitor for and receive from specified network        entity devices data to local gateway module stack modules;    -   Continuously synchronize each local network component's        transmission/reception rate with other paired or clustered group        members' remote network communications components comprising        communications profile priority level, batch/stream type, data        record level, and manual override;    -   Continuous optimization of network communications is performed        for each data record transmitted by:        -   Changing the local network communications component's            current transmission speed:            -   Changing transmission speeds requires the network                communications module to negotiate with the remote                network device to change speeds prior to data                transmission;        -   Switching to another available local network communications            component;    -   Factors involved in optimization include: availability of        multiple local network component connections to the network        device, current transmission speed, network component priority        level, data record type, data type and data record priority        level.        Locational Orientation Module

The locational orientation module (LOM) 26 (see FIGS. 13 and 14) using acombination of hardware and software, provides locational data andgeo-tagging for the gateway. By continuously monitoring and calculatingabsolute and relative oriented data, the LOM performs geo-tagging ofvideo, audio, talk, and voice data streams in addition to transmittingit to network devices.

When first powering up, the LOM audits for all available local hardware130 and system 131 components. Each unique component has an orientationprofile 140 (see FIG. 14 and Table 7, below) maintained and stored bythe LOM containing current location, absolute or relative, prioritylevel, and if local or remote. As changes to gateway group participationalong with local and remote hardware 132 and system 133 componentsoccur, the orientation profiles are maintained and stored by the LOM.

TABLE 7 Orientation Profile Element Description Orientation Profile IDId of specific hardware/system component Local/Remote Local - directlyaccessible Remote - Accessible via a Local Network System OrientationStatus On/Off Priority Level 1—High Priority → x—Lower PriorityOrientation Type Absolute or Relative Current Location Current locationLocational Orientation Module ProcessPower-Up Sequence for Gateway Locational Orientation Module

-   -   Scan for all local hardware and system components physically        within the gateway;    -   Scan for all local system orientation profiles available on any        local data storage components;    -   Scan for available local network communications components; and    -   Wait until the security module has allowed continued processing.        Continuous Locational Orientation Processing Sequence    -   Continuously monitor for entering a paired and clustered group        topology and transmit using local network communications        components stored on data storage components all local        orientation profiles to other group members;    -   Continuously monitor for and process new and updated incoming        orientation profiles from standalone, paired, cluster, managed,        federation, hierarchical, Federation₂ and network groups using        local network communications components or contextual data and        storing on data storage components:        -   New orientation profiles comprise all components; and        -   Updated orientation profiles comprise current location;    -   Continuously monitor for and update the status of all locally        stored orientation profiles;    -   Continuously monitor, calculate and store data current location        to orientation profiles by factoring in local and remote        hardware and system components:        -   GPS unit;        -   Network data system: cellular;        -   Contextual data system: accelerometer;    -   Continuously monitor and transmit to other paired or clustered        group members any changes in local orientation profiles.        Voice Module

The voice module (VM) 27 (see FIGS. 15 and 16), using a combination ofhardware and software, provides voice recognition functionality for thegateway.

By processing audio and talk data signals, local 150 and remote 151, theVM uses a recognition algorithm to generate voice data and gatewaycommand requests. The VM continuously monitors and processes audio andtalk data signals only while in VM monitoring mode.

By continuously monitoring all audio and talk data signals, the VMevaluates each data signal to a pattern stored within a voice profile160 (see FIG. 16 and Table 8, below) and, factoring in a weighted value,determines if a match has occurred and reports it.

TABLE 8 Voice Profile Element Description Voice Profile ID Id ofperson/command Internal Command Gateway internal command for processingWeighted Value Weighted valued used in recognition process Voice PatternPattern for voice recognitionVoice Module ProcessPower-Up Sequence for Gateway Voice Module

-   -   Scan for all local system voice profiles available on any local        data storage components;    -   Scan for available local network communications components; and    -   Wait until the security module has allowed continued processing.        Continuous Voice Processing Sequence    -   Continuously monitor for entering a paired and clustered group        topology and transmit using local network communications        components stored on data storage components all local voice        profiles to other group members;    -   Continuously monitor for and process new and updated incoming        voice profiles from standalone, paired, cluster, managed,        federation, hierarchical, Federation₂ and network groups using        local network communications components or contextual data and        storing on data storage components:        -   New voice profiles comprise all components; and        -   Updated voice profiles comprise voice patterns and weighted            value;    -   Continuously monitor for entering and exiting monitoring mode;    -   While in monitoring mode, continuously monitor all incoming        audio and talk data signals:        -   Local audio and talk data signals using local audio system            components and the gateway audio/video module;        -   Remote audio and talk data signals use local network            communications components and the gateway network            communications module;    -   While in monitoring mode, continuously process all incoming        audio and talk data signals by evaluating the data signal and        reporting a match or not:        -   Evaluation of a data signal involves using the voice            profile's voice pattern and weighted value; and        -   Reporting results includes if a match and the voice            profile's internal command.            Audio/Video Module

The audio/video module (AVM) 28 (see FIGS. 17 and 18), using acombination of hardware and software, provides processing of audio andvideo signals for the gateway. By continuously monitoring any audio andvideo data signals, the AVM processes and routes them to other local orremote applications or output audio signals to local audio output units.

When first powering up, the AVM audits for all available local audio 150and video 170 system components. Each unique component has an audio 180or video 181 profile (see FIG. 18 and Tables 9 and 10, below) maintainedand stored by the AVM including current status, type, priority level,and if local or remote. As changes to gateway group participation alongwith local and remote audio 151 and video 171 system components occur,the audio and video profiles are maintained and stored by the AVM.

TABLE 9 Audio Profile Element Description Audio Profile ID Id ofspecific hardware/system component Audio Status On/Off Audio TypeSpeaker or Microphone Priority Level 1—High Priority → x—Lower PriorityAudio Location Local or Remote Audio Input Signal Type Sound or TalkAudio Characteristics Characteristics necessary in processing signal

TABLE 10 Video Profile Element Description Video Profile ID Id ofspecific hardware/system component Video Status On/Off Video LocationLocal or Remote Priority Level 1—High Priority → x—Lower Priority VideoCharacteristics Characteristics necessary in processing signalAudio/Video Module ProcessPower-Up Sequence for Gateway Audio/Video Module

-   -   Scan for all local audio and video system components physically        within the gateway;    -   Scan for all local audio and video profiles available on any        local data storage components;    -   Scan for available local network communications components; and    -   Wait until the security module has allowed continued processing.        Continuous Audio/Video Processing Sequence    -   Continuously monitor for entering a paired and clustered group        topology and transmit using local network communications        components stored on data storage components all local audio and        video profiles to other group members;    -   Continuously monitor for and process new and updated incoming        audio and video profiles from standalone, paired, cluster,        managed, federation, hierarchical, Federation₂ and network        groups using local network communications components or        contextual data and storing on data storage components:        -   New audio and video profiles comprise all components; and        -   Updated audio and video profiles comprise audio and video            status;    -   Continuously monitor and transmit to other paired or clustered        group members any changes in local audio and video profiles;    -   Continuously monitor all incoming data signals:        -   Local sound data signals using local audio system components            audio input units; and        -   Remote audio and talk data signals using local network            communications components;    -   Continuously process all incoming data signals comprising of        audio characteristics, audio input signal type:        -   Audio input signal type of sound generates audio data            signal; and        -   Audio input signal type of talk generate talk data signal;    -   Continuously monitor all incoming video data signals:        -   Local video data signals using local audio system            components; and        -   Remote video data signals using local network communications            components;    -   Continuously process all incoming video data signals by        evaluating the data signal using video characteristics;    -   Continuously monitor and route when instructed all incoming        audio and talk data signals specified local audio system        components audio output units.        User Interface Module

The user interface module (UIM) 29 (see FIGS. 19 and 20), using acombination of hardware and software, provides processing of userinteraction for the gateway. By continuously monitoring, coordinating,and processing user input 190 and display 191 hardware components, theUIM gathers and routes contextual and video data necessary for gatewayoperation.

When first powering up, the UIM audits for all available local userinput and display components. Each unique component has a user input 200or display 201 profile (see FIG. 20 and Tables 11 and 12, below)maintained and stored by the UIM including current status, type,priority level, and if local or remote. As changes to gateway groupparticipation along with local and remote user input 192 and display 193hardware components occur, the user input and display profiles aremaintained and stored by the UIM.

The UIM continuously monitors and processes all requests of user-deriveddata along with any user directed display of information. Coordinationof local and remote user input IF and user output display hardwarecomponents is driven by incoming data records originating from localgateway stack modules and remote gateways using local networkcommunications components. Any results are returned as contextual datarecord for processing.

TABLE 11 User Input Profile Element Description User IF Profile ID Id ofspecific hardware/system component User IF Status On/Off User IF TypeKeyboard, Joystick, Mouse, Button, Switch, etc. Priority Level 1—HighPriority → x—Lower Priority User IF Location Local or Remote User IFCharacteristics Characteristics necessary in processing signal

TABLE 12 Display Profile Element Description Display Profile ID Id ofspecific hardware/system component Display Status On/Off Display TypeUses Contextual or Video Data Priority Level 1—High Priority → x—LowerPriority Display Location Local or Remote Display CharacteristicsCharacteristics necessary in processing signalUser Interface Module ProcessPower-Up Sequence for Gateway User Interface Module

-   -   Scan for all local user input and display hardware components        physically within the gateway;    -   Scan for all local user input and display profiles available on        any local data storage components;    -   Scan for available local network communications components; and    -   Wait until the security module has allowed continued processing.        Continuous User Interface Processing Sequence    -   Continuously monitor for entering a paired and clustered group        topology and transmit using local network communications        components stored on data storage components all local user        input and display profiles to other group members;    -   Continuously monitor for and process new and updated incoming        user input and display profiles from standalone, paired,        cluster, managed, federation, hierarchical, Federation, and        network groups using local network communications components or        contextual data and storing on data storage components:        -   New user if and display profiles comprise all components;            and        -   Updated user if and display profiles comprise user input and            display status;    -   Continuously monitor and transmit to other paired or clustered        group members any changes in local user input and display        profiles;    -   Continuously monitor all incoming input oriented data signals:        -   Local sound data signals using local user input hardware            interface components;        -   Contextual date from remote user input hardware interface            components using local network communications components;            and        -   Contextual date from local gateway module stack and remote            gateways using local network communications components;    -   Continuously process all incoming data signals and generate        contextual data;    -   Continuously monitor all incoming local video or contextual data        signals; and    -   Continuously process all incoming local video or contextual data        signals and output them to graphical display units, telltales,        or other user audible/visual output devices and controls.        Data Management Module

The data management module (DMM) 30 (see FIGS. 21 and 22), using acombination of hardware and software, provides storage and retrieval ofdata for the gateway. By continuously monitoring and processing datastorage requests, the DMM stores and retrieves from local 210 and remote212 fixed and local 211 and remote 213 removable data storage componentsaudio, talk, video, voice, orientation, control, and contextual data.

When first powering up, the DMM audits for all available local fixed andremovable components. Each unique component has a storage profile 220(see FIG. 22 and Table 13, below) maintained and stored by the DMMincluding current status, type, priority level, and if local or remote.As changes to gateway group participation along with local and remotefixed and removable hardware components occur, the storage profiles aremaintained and stored by the DMM.

The DMM continuously monitors and processes all requests from the localgateway module stack and remote gateways to store or retrieve data fromlocal and remote fixed and removable hardware components. Storagerequests have two types: optimized and manual. Optimized storagerequests involve the DMM factoring in storage profile's current storagecapacity level, storage status, priority level, local/remote and datarecord's priority level, data type. Manual storage requests involve aspecified local or remote fixed or removable data storage component.

TABLE 13 Storage Profile Element Description Storage Profile ID Id ofspecific hardware/system component Current Storage Capacity CurrentStorage level Level Storage Status On/Off Maximum Storage CapacityMaximum Storage Capacity Local/Remote Local - directly accessibleRemote - Accessible via a Local Network System Priority Level 1—HighPriority → x—Lower Priority Control Type Manual or AutomaticData Management Module ProcessPower-Up Sequence for Gateway Data Management Module

-   -   Scan for all local fixed and removable data storage components        physically within the gateway;    -   Scan for all local storage profiles available on any local data        storage components;    -   Scan for available local network communications components; and    -   Wait until the security module has allowed continued processing.        Continuous Data Management Processing Sequence    -   Continuously monitor for entering a paired and clustered group        topology and transmit using local network communications        components stored on data storage components all local storage        profiles to other group members;    -   Continuously monitor for and process new and updated incoming        storage profiles from standalone, paired, cluster, managed,        federation, hierarchical, Federation₂ and network groups using        local network communications components or contextual data and        storing on data storage components:        -   New storage profiles comprise all components; and        -   Updated storage profiles comprise current storage capacity            level and storage status;    -   Continuously monitor and transmit to other paired or clustered        group members any changes in local storage profiles;    -   Continuously monitor and transmit upon request to other gateway        group members using local network communications components any        changes in local storage profiles, including current storage        capacity level and storage status;    -   Continuously monitor and calculate all local fixed and removable        data storage component's current storage levels and record them        in each component's storage profile's current storage level;    -   Continuously monitor and process requests by local gateway        module stack modules and gateway group members using local        network communications components to store or retrieve data        records from a local storage component:        -   a Store requests include:            -   Data types of audio, talk, video, voice, orientation,                control, and contextual data; and            -   Processing includes manual specification of local or                remote data storage component or automatic specification                involving optimization including storage profile's                current storage capacity level, storage status, priority                level, local/remote, and data record's priority level                and data type;        -   Retrieval requests include:            -   Data types of audio, talk, video, voice, orientation,                control, and contextual data; and            -   Processing includes manual specification of local or                remote data storage component or automatic specification                involving optimization including storage profile's                current storage capacity level, storage status, priority                level, local/remote, and data record's priority level                and data type.                Applications Module

The Applications Module (AM) (31) (see FIG. 23), using a combination ofhardware memory and software, provides for the maintenance of allGateway System Stack modules (see FIG. 28). By continuously monitoringand processing requests, the AM dynamically installs, activates andremoves applications for execution within the Gateway Systemarchitecture (230) (231). Control request, from local or remote sources,can provide:

-   -   Executable Gateway Module software    -   Location of local or remote fixed Data Storage Component of        executable module software    -   Module profile information    -   Commands to activate or suspend a module    -   Command to add or remove Gateway Module software

TABLE 13a Applications Module Profile Module Profile Element DescriptionModule Profile ID Id of specific applications module Module StatusOn/Off Starting Location Entry point of application module Local/RemoteLocal - directly accessible Remote - Accessible via a Local NetworkSystem Priority Level 1—Lowest Priority → x—Higher Priority Data TypesUsed Voice, Talk, Audio, Video, Locational, Contextual and Control dataActivation type Cyclic, Event, Both Cycle Time How often to start themoduleApplications Module ProcessPower-Up Sequence for GCS Applications Module

-   -   Scan for all Local Module Profiles within the GCS    -   Scan for all Local Storage Profiles available on any Local Data        Storage Components.    -   Scan for available Local Network Communications Components    -   Wait until the eyeCam Security Module has allowed continued        processing        Continuous Applications Processing Sequence    -   Continuously monitor for activation by CCM    -   Continuously monitor for local or remote module command requests        -   Local module command requests via Local User Interface        -   Remote module command requests over the Network    -   Process incoming module command requests:        -   Modify Module Status to active or suspend execution of            Gateway Module        -   Remove Gateway Module's profile on request to delete a            module and remove from local Gateway memory        -   Add a profile entry of a Gateway Module            -   Retrieve profile entry and executable software code from                a local Network Communications component            -   Retrieve profile entry and executable software code from                a local Data Storage component                Network Topologies of Gateway                Standalone Gateway                Characteristics of a Standalone Gateway                Embedded Standalone Gateway

An embedded standalone version of a gateway device has access to thefunctions and components shown in Table 14, below.

TABLE 14 Embedded Standalone gateway Local Component Network gatewayModule Control Component Control Security Full Limited cooperativeaccess Control Center Full Limited cooperative access Power ManagementFull Limited cooperative access Communications Management Full Limitedcooperative access Device Networking Full Limited cooperative accessLocation Full Limited cooperative access Voice Full Limited cooperativeaccess Audio/Video Full Limited cooperative access Display Full Limitedcooperative access User Interface Full Limited cooperative access DataManagement Full Limited cooperative access Applications Full Limitedcooperative accessDownloadable Standalone Gateway

A downloadable standalone version of a gateway device has access to thefunctions and components shown in Table 15, below.

TABLE 15 Downloadable Standalone gateway gateway Network Module LocalComponent Control Component Control Security Limited to local OS accessLimited cooperative access Control Center Limited to local OS accessLimited cooperative access Power Limited to local OS access Limitedcooperative access Management Commu- Limited to local OS access Limitedcooperative access nications Management Device Limited to local OSaccess Limited cooperative access Networking Location Limited to localOS access Limited cooperative access Voice Limited to local OS accessLimited cooperative access Audio/Video Limited to local OS accessLimited cooperative access Display Limited to local OS access Limitedcooperative access User Interface Limited to local OS access Limitedcooperative access Data Limited to local OS access Limited cooperativeaccess Management Applications Limited to local OS access Limitedcooperative accessStandalone Gateway Description

A standalone gateway performs its functions using its local hardwarecomponents fully while requesting access of other network based devicecomponents. Functionality is initially defined after a complete audit isperformed of local hardware components and active gateway modules.Additional functionality occurs when granted access to network basedhardware components and their associated gateway modules.

Example of a Standalone Gateway—Headset

A gateway headset 250 (see FIG. 25 and U.S. patent application Ser. No.12/714,693, filed 1 Mar. 2010, which application is incorporated hereinin its entirety by this reference thereto), upon turning on power,performs a complete audit of all available hardware components,including network, audio, video, storage and user interface. This auditis performed by the gateway executing all available gateway modulepower-up sequences and determining both hardware and moduleavailability. For this example, it was pre-configured to only active theheadset after user #1 has login using his voice. Once powered up in itslogin state, the headset waits for user #1 to successfully login. Afteruser #1 has logged in, the gateway indicates to all available modules tomigrate to their continuous process sequence

Formation of Standalone Gateway Headset

-   -   On power-up, the gateway headset starts the embedded gateway:        -   Detect all available local gateway module plug and play            profiles:            -   Operating system module;            -   Security module;            -   Control center module;            -   Power management module;            -   Network communications module;            -   Locational orientation module;            -   Voice module;            -   Audio/video module;            -   User interface module; and            -   Data management module;        -   Execute each plug and play profile's power-up sequence to            determine all available gateway modules and local hardware            components:            -   Operating system module;            -   Security module security profiles for:                -   User #1;            -   Control center module;            -   Power management module power profiles for:                -   Pmic;                -   Imager;                -   Audio;                -   Cellular;                -   WiFi;                -   Wimax;                -   Bluetooth                -   GPS;                -   Ethernet IEEE 802.3af;                -   User buttons;                -   User indicators;                -   User display;                -   Accelerometer; and                -   Internal battery;            -   Network communications module communications and network                profiles for:                -   Communications profiles:                -    Bluetooth;                -    WiFi;                -    Wimax;                -    USB; and                -    Cellular;                -   Network profiles: none;            -   Locational orientation module orientation profiles for:                -   GPS unit;                -   Accelerometer; and                -   Cellular baseband;            -   Voice module voice profiles for:                -   User #1;            -   Audio/video module:                -   Imager (video camera);                -   Dual microphone;                -   Speaker;            -   User interface module:                -   UI display;            -   Data management module storage profiles; and            -   Login application module login profiles for:                -   Power-up sequence.                    Execution of Standalone Gateway Headset Login                    Sequence    -   User #1 pushed gateway headset on button;    -   The gateway runs through its power-up sequence;    -   The gateway powers up only user interface oriented local        hardware components:        -   User interface display; and        -   Microphone;    -   The gateway executes login application module;    -   The gateway sends to the audio/video module control data        indicating incoming voice signal;    -   The login application module executing the power-up sequence        profile:        -   Display login message on user interface display;    -   User #1 speaks into microphone component;    -   Audio/video module inputs signal and, based on control data,        performs noise cancelation on audio signal and creates voice        data;    -   The gateway sends to the voice module voice data and control        data indicating login;    -   The voice module compares voice data with user #1 login voice        pattern and responds with control data indicating login voice        match; and    -   The gateway sends control data to all available the gateway        modules security clear and to migrate to continuous process        sequence.        Computer Implementation

FIG. 26 is a block schematic diagram of a machine in the exemplary formof a computer system 1600 within which a set of instructions for causingthe machine to perform any one of the foregoing methodologies may beexecuted. In alternative embodiments, the machine may comprise orinclude a network router, a network switch, a network bridge, personaldigital assistant (PDA), a cellular telephone, a Web appliance or anymachine capable of executing or transmitting a sequence of instructionsthat specify actions to be taken.

The computer system 1600 includes a processor 1602, a main memory 1604and a static memory 1606, which communicate with each other via a bus1608. The computer system 1600 may further include a display unit 1610,for example, a liquid crystal display (LCD) or a cathode ray tube (CRT).The computer system 1600 also includes an alphanumeric input device1612, for example, a keyboard; a cursor control device 1614, forexample, a mouse; a disk drive unit 1616, a signal generation device1618, for example, a speaker, and a network interface device 1628.

The disk drive unit 1616 includes a machine-readable medium 1624 onwhich is stored a set of executable instructions, i.e. software, 1626embodying any one, or all, of the methodologies described herein below.The software 1626 is also shown to reside, completely or at leastpartially, within the main memory 1604 and/or within the processor 1602.The software 1626 may further be transmitted or received over a network1630 by means of a network interface device 1628.

In contrast to the system 1600 discussed above, a different embodimentuses logic circuitry instead of computer-executed instructions toimplement processing entities. Depending upon the particularrequirements of the application in the areas of speed, expense, toolingcosts, and the like, this logic may be implemented by constructing anapplication-specific integrated circuit (ASIC) having thousands of tinyintegrated transistors. Such an ASIC may be implemented withcomplementary metal oxide semiconductor (CMOS), transistor-transistorlogic (TTL), very large systems integration (VLSI), or another suitableconstruction. Other alternatives include a digital signal processingchip (DSP), discrete circuitry (such as resistors, capacitors, diodes,inductors, and transistors), field programmable gate array (FPGA),programmable logic array (PLA), programmable logic device (PLD), and thelike.

It is to be understood that embodiments may be used as or to supportsoftware programs or software modules executed upon some form ofprocessing core (such as the CPU of a computer) or otherwise implementedor realized upon or within a machine or computer readable medium. Amachine-readable medium includes any mechanism for storing ortransmitting information in a form readable by a machine, e.g., acomputer. For example, a machine readable medium includes read-onlymemory (ROM); random access memory (RAM); magnetic disk storage media;optical storage media; flash memory devices; electrical, optical,acoustical or other form of propagated signals, for example, carrierwaves, infrared signals, digital signals, etc.; or any other type ofmedia suitable for storing or transmitting information.

Although the invention is described herein with reference to thepreferred embodiment, one skilled in the art will readily appreciatethat other applications may be substituted for those set forth hereinwithout departing from the spirit and scope of the present invention.Accordingly, the invention should only be limited by the Claims includedbelow.

What is claimed is:
 1. A computer implemented communications gateway,comprising: a storage medium having stored therein program instructionswhich comprise a multitasking operating system which is partitioned intoa module core layer, a module OS interface layer, and an operatingenvironment; wherein said module core layer is configured to performhigh level, coordinated functionality and comprises core gatewaysoftware that is compiled and linked only; wherein said module OSinterface layer is configured to directly allow a module applicationslayer within said operating environment to map a module core layer I/Owith a given device's resident operating system; wherein said module OSinterface layer is configured to be customized, compiled, and linkedwith said module core layer to a plurality of sequentially, autonomousmodules, each module being configured to communicate with hardware andother gateway modules; and wherein said gateway modules collectivelycomprise a gateway stack (GS).
 2. The gateway of claim 1, wherein saidGS is configured to effect any of duplex-directional multimedianetworking, power optimization, dynamic configuration, communications,and data management.
 3. The gateway of claim 1, wherein said GS isconfigured to effect any of device automation, modular system and datamanagement, data channeling, paired, grouped and/or networked deviceoptimization, and hands-free and remote systems control.
 4. The gatewayof claim 1, said GS further comprising: a virtual machine monitor thatis configured to run in an embedded system as either a downloadableprogram or as a networked application.
 5. A multitasking system thatprovides functional expandability and portability to various operatingenvironments, and interoperability with existing operating systems,comprising: a gateway control system comprising a processor configuredfor managing device optimization in an intelligent semi-autonomousmodular architecture; and said architecture comprising a plurality oftask-specific modules in which each module is configured to select amethod for accomplishing its specific task based on user configurationsfor power, data, device, network, security, and communications.
 6. Thesystem of claim 5, wherein said processor is configured to implement acapability-based security function that provides dynamic customizableuser, device, and network authorization settings and both channel andmodule data level encryption; wherein said security function isconfigured to allow a user to select to encrypt both a real-time datafeed or uploaded file for access by a specific user or group of users ona specific device, group of devices, or network, or create differentaccess settings for different data feeds, wherein different channels arebroadcast to specific targeted users and devices and/or a single datastream is sent out to multiple users, and each user only has access tofeeds for which they have authorization.
 7. The system of claim 5,wherein said processor is configured to allow two or more autonomousnetworked computing devices to pair or join a gateway unified,federated, or managed group connection; said system comprising a modulethat is configured to expand sets of each of a plurality of autonomousgateway devices to include components of all unified networked gatewaydevices, wherein said module comprises a single gateway module stackthat is mirrored by each grouped device.
 8. The system of claim 7,further comprising: a unified group of gateway devices in which anindividual module stack in each device acknowledges and adopts relatedcomponents and systems of all other networked devices, and groups saidadopted related components and systems into a networked component set;and a resulting unified module stack that is configured to determine amost efficient distribution of system priorities, tasks, andresponsibilities collectively for an entire group of said devices. 9.The system of claim 8, wherein each device has its own module stack andpriority settings with which either a user either selects a preferredprimary device or a collective group module stack automatically selectsa primary device based on optimum computing power, data storage,networking capabilities, available power, security settings, or otherdevice capabilities to insure cooperation between devices and modules.10. The system of claim 5, wherein all data collected and managed byeach module operates as an independent channel with all modules and datacoordinated with other modules; wherein said data is either grouped withother module data and sent out collectively over a single wired orwireless network, or it is broadcasted independently via a unique datachannel over multiple available networks; wherein a gateway devicehaving a cellular device can communicate with a WiFi device by meshnetworking with one or more gateway cellular and WiFi enabled devicesand wireless routers, which then relay a data stream securely to andfrom a targeted user.
 11. The system of claim 5, wherein said gatewaycontrol system operates as an individual or collective group and ad hocnetwork of devices, said gateway control system comprising a platformfor dynamic formation and management of peer-to-peer communications viamultiple wired and wireless network connections and networkconfigurations.
 12. The system of claim 11, wherein said gateway controlsystem comprises an organized data and network management platform anddynamic source routing system; and further comprising: a plurality ofgateway stacks of two or more gateway devices that recognize each otherbased on security settings, wherein each gateway device is configured tojoin into a unified group that combines the modules of both devices andin which each device adopts the capabilities of the other device andthen generates a new priority setting for both networked devices. 13.The system of claim 11, further comprising: a user or user group joinedto a federated network of gateway devices in which all devices maintaintheir autonomy and share data and network channeling, devicecoordination, and optimized communications, but have no device, data, orsystem management and no remote systems control.
 14. The system of claim11, further comprising: a hierarchal managed network comprising aserver-based managed gateway network set up by an enterprise or agencyin which all issued gateway enabled wireless devices are authorized as amanaged device and then either permanently assigned to a specific useror temporarily assigned to a specific user or group of users with alluser, device, data and network authorization set up via a network basedhierarchy.
 15. The system of claim 11, further comprising: a managednetwork comprising a standard smart phone device operating as a gatewaymanaged network device, wherein all systems and security settings arelocalized to said device but can only be altered either remotely orlocally via a network by an authorized network manager.
 16. The systemof claim 11, wherein all gateway devices automatically select a methodfor transferring data and communicating amongst other connected devicesand for transferring data using all available wired and wirelessnetworks, based on coordinated networking and computing power of eachindividual device and of the collective group.
 17. A computerimplemented communications gateway, comprising: at least one processorfor executing gateway software partitioned into a plurality of modules,each module comprising sequentially, autonomous code, each module beingconfigured to communicate with hardware and other gateway modules, allgateway modules collectively comprising a gateway stack, wherein eachmember of said gateway stack is turnable on or off, downloaded from aremote site, and dynamically configure a module core layer configured toperform high level, coordinated functionality; and a plurality oftargeted environments for implementing the gateway.
 18. The gateway ofclaim 17, wherein-said targeted environments comprise: a gateway controlenvironment comprising core functionality software that is partitionedfrom targeted system dependent software and that is configured to runthe gateway in either an embedded environment or as a downloadableimage, said gateway control environment configured for multitaskingcapability and to dynamically download, install, and execute new tasks,and to control task execution characteristics remotely; a powermanagement environment configured to perform power managementfunctionality dynamically by constantly monitoring, managing, andoptimizing power use for all device systems, components, andapplications based on any of component characteristics, power usehistory, time since last used, priority settings, security level,network topology, and user preferences; a data environment wherein datathat is collected and managed by each module operates as an independentchannel with all modules and wherein data coordinated with other modulesis either grouped with other module data and sent out collectively overa single wired or wireless network or broadcast independently via aunique data channel over multiple available networks; a user environmentin which an authorized and verified user, user group, and/or networkmanager can customize core functionality of any gateway enabled device,group, or network by defining use preferences for each gateway moduleand security and networking preferences for all related modular systemscontrol and modular data management, access, channeling, andcommunications; and a network environment.
 19. The gateway of claim 17,further comprising: a module core layer configured to perform highlevel, coordinated functionality; and a module OS interface layerconfigured to allow a module applications layer to map a module corelayer I/O with a given device's resident operating system, a modulenetwork interface configured for device-to-device, device-to-group, anddevice-to-network data, systems, and module core Layer interfacecoordination, data channeling, and systems optimization, over one ormany network topologies, based on optimum efficiency and securitysettings of each device and of an entire group.
 20. The gateway of claim17, further comprising: a plurality of targeted environments for thegateway focused within any of the following areas: hands-free wirelessdevices; cameras, cell phones, smart phones, and PDA's; tablets, PC's,networked televisions, and video gaming systems; vehicle media systems,dashboard consoles, telematics, and other vehicular computing systems,fleet management and transportations systems supporting an ad-hocnetworking platform; home security, entertainment, and command centers;and enterprise, private security, government departments, agencies, andnetworks: consumer, enterprise and government cellular and satelliteWireless Carrier Networks, VPN's, VOIP and wired Internet ServiceProviders.